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ABSTRACT 

Nassau Community College (NCC) is currently working 
with a program evaluation model in which faculty from one department 
serve as peer evaluation consultants to direct the self-evaluations 
of other departments. The four functional objectives initially 
motivating the development of NCC's plan directed that: real 
decisions about academic programs should result from program review 
and involve the joint participation of faculty and administrators; 
objective information reviewed and analyzed as part of the program 
review should be the basis for program decisions; community needs 
should be examined as part ot the program review; and a practicial 
timetable should provide for the timely review of academic programs 
from which decisions of current value are produced. The peer 
consultants, who are generally selected from faculty who have 
previously participated in the curricular evaluations within their 
own departments, administer evaluation activities undertaken in four 
phases: (1) needs assessment, which involves a survey of constituent 
groups regarding program goals and a conference to promote consensus 
among diverse groups about specific program okiectives; (2) outcomes 
assessment, which includes an examination of t a extent to which 
proposed goals are being achieved; (3) review of program objectives, 
which uses the results of the previous phases to make early decisions 
about desired modifications; and (4) impact assessment, which 
provides for a follow-up by program faculty of the effect of the 
program modifications in producing intended improvements. (LAL) 
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ACADEMIC PLANNING THROUGH PROGRAM REVIEW - CAN IT '. lORK? 



"Bat we alfiexidy did ttUii ^o/l oujl pfLognx^m'A tice-MUAZ /L&a,ccAzdUa.tLon!" 

"Ouutcoma^ A6-6W4mew^? {t)kcut kind icJiQon l& tkli?" 

"OJhat li tho: admini&tAjOLUon JioMy going to do mXh thU tnlomaXion?" 

Even more compelling than these reactions from program faculty are the 
questions asked by those charged with administering the review of academic 
programs at our campuses: How do we make program review work? What do we 
do to encourage academic departments to accept the challenge to examine 
their curricular programs critically? Such questions serve to exemplify 
the reality that" al though universally accepted as a necessary process, pro- 
gram review is often viewed as unproductive of tangible benefits. 

Perceptions concerning the benefits of various forms of program review 
do, of course, depend on one's perspective within the institution, .'.dminis- 
trators, for example, often view program self-evaluation as being hopelessly 
self-serving to faculty ends while simply preserving the status quo. Program 
faculty, on the other hand, tend to view the use of external evaluators as 
being slanted to the budgetary concerns of campus administrators and largely 
insensitive to educational concerns. 

One campus, look4-ng for a viable middle ground, is currently working 
with a model in which faculty from one department are employed to direct the 
self-evaluations of others. Under this approach, faculty are external with 
regard to objectivity toward the department and programs which they assist 
to review, but are internal with respect to knowledge and understanding of 
the campus. 

The development of such a model for application to other campuses is 
being undertaken by Nassau Comnunity Coilege under a grant from the U.S. 
Department of Education's Fund for the Improvement of Postsecondary Educa- 
tion. There were four functional objectives initially motivating the de- 
velopment of the Nassau plan: 



- Rfctte d(LU6loyu> about academic programs should result 
from program review and involve the joint participation 
of faculty and administrators, 

- ObiQcXivz injoAmaUon reviewed and analyzed as part of 

the program review should be the basis for program decisions. 

- ComanUy madU should be examined as part of the program 
review to provide a broader view of the expectations of 
constituent groups. 

- A pjiactiaal timztabU should provide for the timely review 
of academic programs from wnich decisions of current value 
to the College are produced, 

» 

The approach being developed in the Nassau project involves the training 
and deployment of a number of key faculty to serve as peer evaluation consult- 
ants for other departments in the self-evaluation of their academic programs. 
The Peer Consultants (as they are called) are generally selected from faculty 
who have previouslv participated in the curricular evaluations within their 
own departments. In this way the number of such faculty who are i<sed to phase- 
in other departmental evaluations grows geometrically within the total campus 
evaluation cycle. 

One such progression is depicted in ihe accompanying figure in which six 
Peer Consultants are selected from three departments concluding the first 
phci'.e of evaluations of Nassau's academic programs. 

- - Insert Figure 1 here - - 
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FIGURE I 

SEQUENCE OF DEPARTMENT/iu SELF-EVALUATION 

USING Trained pee.^ consultants 
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The six Peer Consultants participate in a training regime, after which 
they administer the evaluations of six other program departments from which 
12 new Peer Consultants emerge.. Thus, by the third phase evaluations, 18 
additional program departments are involved, for a total of 27 departmental 
evaluations in all . 

The evaluation activities administered by the Peer Consultant with the 
faculty of a given academic program are undertaken in four stages, the over- 
all sequence of which is identified in the accompanying figure. 

- - Insert Figure 2 here • - 
The initial activity - 

NEEDS ASSESSMENT 

'utilizes a preliminary survey to identify the broad expectations of constitu- 
ent groups regarding program goals. This is followed by a Conference on Pro- 
gram goals which utilizes a modification of the Delphi Technique to promote 
consensus among diverse groups about specific program objectives. Typically, 
expectations regarding such areas of program functioning as baccalaureate 
transfer, career employment, in-service courses, community service and specia 
skills are examined in this phase of the program evaluation. 

A second stage - 

OUTCOMES ASSESSMENT 
{2nd SmQJ>t2Ji] 

involves an examination of the extent to which the proposed 9oals are being 
achieved, as revealed through specific measurements of program performance. 
Such measures as program attrition, academic achievement of program students. 
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and transfer and employment of program graduates are among the data frequently 
reviewed by faculty in this phase. Both the timetable and quality of the ex- 
amination of program outcomes by faculty is greatly advanced by the production 
01^ a Profile on Program Performance by Nassau's Office of Institutional Research 
The Profile serves to develop a description of'all programs at the College ac- 
cording to a uniform set of ten performance measures. This provides a common 
core of institutional information wfeich can be examined uniformly by program 
faculty in the outcomes assessment phase; additionally, other areas of special 
concern to ttie department are also px-amined. by program faculty. ^ 

The third activity - 

REVIEW OF PROGRAM OBJECTIVES 

is the stage in which the program goals identified in the Needs Assessment and 
the examination of program performance in. the Outcomes Assessment are utilized 
as the basis for early decisions regarding desired modifications. This charge 
is given to a special campus committee which includes representation from the 
campus Acade.Tiic Senate, the campus Curriculum Committee, departmental faculty, 
and the college administration and trustees. 

This is a crucial phase of' the process-the payoff. In the final analysis, 
the success with which systematic program improvements are brought about de- 
pends strongly on the commitment which program faculty have to the process by 
which such decisions are made. It is important, therefore, that the decisions 
which emerge here are made jointly between program faculty and other respected 
members of the college community. The negotiations may be substantial and com- 
plex, but must ultimately be translated into desired performance objectives 
and the modification of program practices necessary to achieve them. 
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The remaining activity - 

IMPACT ASSESSMENT 



which completes the evaluation cycle, provides for a follow-up look by pro- - 
gram faculty of th6 effect of the program modifications in^.producing intended 
improvements. In effect, this last activity involves the .*:ontinuation by pro- 
gram faculty of selected measures from their^ outcomes as/essment. In this 
manner, new performa xe level's of the program can be measured which,, at this, 
point, would have already been modified in a deliberate way. 

What is the role of the Peer Consultant in all of this? It may vary with 
regard to specific demands as determined by the needs of the program faculty 
involved in the evaluation. Generally, though, the Peer Consultant serves t^ 
facilitate the progress of the evaluation being conducted by program faculty, 
and does not serve as an'external evaluator. Typically, for example, the 
Peer Consultant would 1) initiate the planning and design of the Needs and 
Outcomes Assessments to be implemented by program faculty, 2) assist faculty 
in identifying where and how to collect and examine program data, and 3) keep 
the progrsss of the evaluation according to the prescribed timetable. The 
Peer Consultant also participates with the department in the third semester 
deliberations in which decisions concerning desired program modifications 
are determined. 

Beyond the iimediate benefits to the programs of the Nassau Campus and 
the 23,000 students enrolled there, the project is expected to produce pub- 
lished procedures involved in the evaluation process itself in a highly use- 
able and adaptable format for dissemination to a wider audience. The antici- 
pated dissemination products include a published "How to do it" Manual on 
Practical Self-Evaluation as well as a coordinated series of video tape cas- 
settes for the Training of Faculty Peer Consultants . 
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